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ABSTRACT 


The  purpose  of  this  Velldetlon  Suasery  Report  is  to  present  the  results 
and  conclusions  of  perfomlng  etandardized  testa  on  the  Hone3rvell 
Infomatlon  Systems  (HIS),  CCOS  6  Ada  compiler.  Version  2.0.  On>alCe 
testing  was  performed  by  the  Federal  Software  Management  Support  Center 
(FSHSC)->an  Ada  Validation  Facility* •  In  accordance  with  current  Ada 
Validation  Office  policies  and  procedures.  On*site  testing  was 
performed  IS  •  22  November  1985  at  Hmeywell  Information  Systems  Inc., 
Billerica,  HA.  and  Lawrence,  MA. 

''The  suite  of  tests  known  as  the  Ada  Compiler  Validation  Capability 
(ACVC) ,  Version  1.6,  was  used.  The  ACVC  suite  of  tests  is  used  to 
validate  conformance  of  the  compiler  to  ANSI/MIL* STD* 1815A  (Ada).  This 
standard  is  described  In  the  ANSI  Ada  Reference  Manual,  January  1983. 
Not  all  tests  in  the  ACVC  test  suite  are  applicable  to  this  specific 
Implementation.  Also,  knovm  test  errors  in  Version  1.6  are  present  in 
some  tests;  these  tests  were  withdrawn.  -The  purpose  of  the  testing  is 
to  ensure  that  the  compiler  properly  Implements  legal  language 
constructs  and  that  it  identifies,  rejects  from  processing,  and  labels 
illegal  constructs. 

The  HIS  CCOS  6  Ada  Compiler  Version  2.0,  using  MOD  400  Operating  System 
releases  3.0  and  3.1,  was  tested  with  version  1.6  of  the  ACVC  validation 
tests.  Version  1.6  of  the  test  suite  contains  2162  tests  of  which  66 
were  withdrawn  and  180  were  Inapplicable  to  this  implementation.  All  of 
the  1916  remaining  tests  were  passed. 

HIS  Ada  Compiler  was  tested  on  those  systems  listed  in  the  table  below. 
Each  system  was  able  to  host  the  compiler  and  target  itself.  The  table 
represents  the  tested  target/host  relationships: 


Ural 

Op  JSyg 

Zfixm 

Op  Sys 

ACVC  Portion 

Test  Location 

DPS  6/95 

3.0 

DPS  6/95 

3.0 

Full 

On*Site 

DPS  6/75 

3.0 

Subset 

On*Site 

DPS  6/95 

3.1 

DPS  6/95 

3.1 

Full 

On*Site 

DPS  6/75 

3.1 

Subset 

On*Site 

DPS  6/94 

3.0 

DPS  6/94 

3.0 

Full 

Pre-Val 

DPS  6/94 

3.1 

DPS  6/94 

3.1 

Full 

Pre*Val 

DPS  6/85 

3.1 

DPS  6/85 

3.1 

Subset 

On*Site 

DPS  6/75 

3.1 

Subset 

(>n*Site 

DPS  6/75 

3.0 

DPS  6/75 

3.0 

Subset 

Pre*Val 

DPS  6/75 

3.1 

DPS  6/75 

3.1 

Subset 

Pre*Val 

DPS  6/74 

3.0 

DPS  6/74 

3.0 

Subset 

Fre*Val 

DPS  6/74 

3.1 

DPS  6/74 

3.1 

Subset 

Pre*Val 

DPS  6/70 

3.0 

DPS  6/70 

3.0 

Subset 

Pre*Val 

DPS  6/70 

3.1 

DPS  6/70 

3.1 

Subset 

Pre*Val 
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ABSTRACT 


The  purpose  of  this  Valldetlon  Suaaery  Report  is  to  present  the  results 
nnd  conclusions  of  perfoming  standerdized  tests  on  the  Honeywell 
Information  Systems  (HIS),  GCOS  6  Ada  compiler,  Version  2.0.  On-site 
testing  was  performed  by  the  Federal  Software  Management  Support  Center 
(FSHSC)--an  Ada  Validation  Facility-*  in  accordance  with  current  Ada 
Validation  Office  policies  and  procedures.  On-site  testing  was 
performed  IS  •  22  November  1985  at  Honeywell  Information  Systems  Inc., 
Billerica,  MA.  and  Lawrence,  NA. 

The  suite  of  tests  known  as  the  Ada  Compiler  Validation  Capability 
(ACVC),  Version  1.6,  was  used.  The  ACVC  suite  of  tests  is  used  to 
validate  conformance  of  the  compiler  to  ANS1/MIL-STD-181SA  (Ada).  This 
standard  is  described  in  the  ANSI  Ada  Reference  Manual,  January  1983. 
Not  all  tests  in  the  ACVC  test  suite  are  applicable  to  this  specific 
implementation.  Also,  known  test  errors  in  Version  1.6  are  present  in 
some  tests;  these  tests  were  withdrawn.  The  purpose  of  the  testing  is 
to  ensure  that  the  compiler  properly  implements  legal  language 
constructs  and  that  it  identifies,  rejects  from  processing,  and  labels 
illegal  constructs. 

The  HIS  GCOS  6  Ada  Compiler  Version  2.0,  tising  MOD  400  Operating  System 
releases  3.0  and  3.1,  was  tested  with  version  1.6  of  the  ACVC  validation 
tests.  Version  1.6  of  the  test  suite  contains  2162  tests  of  which  66 
vere  withdrawn  and  180  were  Inapplicable  to  this  implementation.  All  of 
the  1916  remaining  tests  were  passed. 

HIS  Ada  Compiler  was  tested  on  those  systems  listed  in  the  table  below. 
Each  system  was  able  to  host  the  compiler  and  target  Itself.  The  table 
represents  the  tested  target/host  relationships; 


Host 

Apyg  por^iPP 

Test  Location 

DPS  6/95 

3.0 

DPS  6/95 

3.0 

Pull 

On-Site 

DPS  6/75 

3.0 

Subset 

On-Site 

DPS  6/95 

3.1 

DPS  6/95 

3.1 

Full 

On-Site 

DPS  6/75 

3.1 

Subset 

On-Site 

DPS  6/94 

3.0 

DPS  6/94 

3.0 

Full 

Pre-Val 

DPS  6/94 

3.1 

DPS  6/94 

3.1 

Full 

Pre-Val 

DPS  6/85 

3.1 

DPS  6/85 

3.1 

Subset 

On-Site 

DPS  6/75 

3.1 

Subset 

On-Site 

DPS  6/75 

3.0 

DPS  6/75 

3.0 

Subset 

Pre-Val 

DPS  6/75 

3.1 

DPS  6/75 

3.1 

Subset 

Pre-Val 

DPS  6/74 

3.0 

DPS  6/74 

3.0 

Subset 

Pre-Val 

DPS  6/74 

3.1 

DPS  6/74 

3.1 

Subset 

Pre-Val 

DPS  6/70 

3.0 

DPS  6/70 

3.0 

Subset 

Pre-Val 

DPS  6/70 

3.1 

DPS  6/70 

3.1 

Subset 

Pre-Val 
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Introduction 


Testing  of  this  compiler  vas  conducted  by  the  Federal  Software 
Management  Support  Center  tinder  the  supervision  of  the  Ada 
Validation  Office  (AVO) ,  at  the  direction  of  the  Ada  Joint 
Program  Office.  Testing  vas  conducted  from  15-22  November, 
1985  at  Honeywell  Information  Systems,  Billerica,  Mass,  and 
Latnrence,  Mass.  All  testing  vas  performed  in  accordance  with 
AVO  policies  and  procedures. 


The  purpose  of  this  report  is  to  document  the  results  of  the  testing 
performed  on  the  compiler,  and  in  particular,  to: 

identify  any  language  constructs  supported  by  the 
compilers  that  do  not  conform  to  the  Ada  standard; 

identify  any  unsupported  language  constructs  required  by 
the  Ada  standard;  and 

describe  implementation  dependent  behavior  allowed  by 
the  standard. 

1 . 2  Host  to  Target  Relationship  Table 

The  Honeywell  GCOS  6  Ada  Compiler  was  tested  on  those  systems 
listed  in  the  table  below.  Each  system  was  able  to  host  the 
compiler  and  target  itself.  The  following  table  represents  the 
tested  target/host  relationships: 


Host 

Pp  Jy? 

Ifllget 

Pp  gy? 

ACVC  Portion 

Test  Location 

DPS  6/95 

3.0 

DPS  6/95 

3.0 

Full 

On-Site 

DPS  6/75 

3.0 

Subset 

On-Site 

DPS  6/95 

3.1 

DPS  6/95 

3.1 

Full 

On-Site 

DPS  6/75 

3.1 

Subset 

On-Site 

DPS  6/94 

3.0 

DPS  6/94 

3.0 

Full 

Pre-Val 

DPS  6/94 

3.1 

DPS  6/94 

3.1 

Full 

Pre-Val 

DPS  6/85 

3.1 

DPS  6/85 

3.1 

Subset 

On-Site 

DPS  6/75 

3.1 

Subset 

On-Site 

DPS  6/75 

3.0 

DPS  6/75 

3.0 

Subset 

Pre-Val 

DPS  6/75 

3.1 

DPS  6/75 

3.1 

Subset 

Pre-Val 

DPS  6/74 

3.0 

DPS  6/74 

3.0 

Subset 

Pre-Val 

DPS  6/74 

3.1 

DPS  6/74 

3.1 

Subset 

Pre-Val 

DPS  6/70 

3.0 

DPS  6/70 

3.0 

Subset 

Pre-Val 

DPS  6/70 

3.1 

DPS  6/70 

3.1 

Subset 

Pre-Val 
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The  Ada  Validation  Office  nay  nake  full  and  free  public 
disclosure  of  this  report  in  accordance  with  the  "Freedom  of 
Information  Act"  (5  U.S.C.  #552).  The  results  of  the 
validation  apply  only  to  the  computers,  operating  systems,  and 
compiler  version  identified  in  this  report. 

The  Ada  Compiler  Validation  Capability  is  used  to  determine 
Insofar  as  is  practical,  the  degree  to  which  the  subject 
compiler  conforms  to  the  Ada  standard.  Thus,  this  report  is 
necessarily  discretionary  and  judgemental.  The  United  States 
Government  does  not  represent  or  warrant  that  the  statements, 
or  any  one  of  them,  set  forth  in  this  report  are  accurate  or 
complete,  nor  that  the  subject  compiler  has  no  other 
nonconformances  to  the  Ada  standard.  This  report  is  not  meant 
to  be  used  for  the  purpose  of  publicizing  the  findings 
summarized  herein. 

Any  questions  regarding  this  report  or  the  validation  tests 
should  be  sent  to  the  Ada  Validation  Office  at: 

Ada  Joint  Program  Office 
1211  South  Fern  Street 
Arlington,  VA  22202 

References 

Reference  Manual  for  the  Ada  Programming  Language, 
ANSI/MIL-STD-1815A,  February  1983. 

Ada  Validation  Organization:  Policies  and  Procedures,  Mitre 

Corporation,  June  1982,  PB  83-110601. 

Ada  Compiler  Validation  Implementers*  Guide,  SOFTECH,  Inc., 
October  1980. 

The  Ada  Compiler  Validation  Capability,  Computer,  Vol.  14,  No. 
6,  June  1981. 

Using  the  ACVC  Tests,  SofTech,  Inc.  November  1981. 


Ada  Compiler  Validation  Flans  and  Procedures,  SofTech,  Inc. 
November  1981. 


1.5 


Definitions  of  Terms 

Class  A  tests  are  passed  if  no  errors  are  detected  at  compile 
time.  Although  these  tests  are  constructed  to  be  executable, 
no  checks  can  be  performed  at  run-time  to  see  if  the  test 
objective  has  been  met;  this  distinguishes  Class  A  from  Class  C 
tests.  For  example,  a  Class  A  test  might  check  that  keywords 
of  other  languages  (other  than  those  already  reserved  in  Ada) 
are  not  treated  as  reserved  words  by  an  Ada  implementation. 

Class  B  tests  are  illegal  programs.  They  are  passed  if  all  the 
errors  they  contain  are  detected  at  compile -time  (or 
link-time)  and  no  legal  statements  are  considered  illegal  by 
the  compiler. 

Class  L  tests  consist  of  illegal  programs  whose  errors  cannot 
be  detected  until  link  time.  They  are  passed  if  errors  are 
detected  prior  to  beginning  execution  of  the  main  program. 

Class  C  tests  consist  of  executable  self-checking  programs. 
They  are  passed  if  they  complete  execution  and  do  not  report 
failure . 

Class  D  tests  are  capacity  tests.  Since  there  are  no  firm 
criteria  for  the  number  of  identifiers  permitted  in  a 
compilation,  number  of  units  in  a  library,  etc.,  a  compiler 
may  refuse  to  compile  a  class  D  test.  However,  if  such  a  test 
is  successfully  compiled,  it  should  execute  without  reporting  a 
failure . 


Class  E  tests  provide  information  about  an  implementation's 
interpretation  of  the  Standard.  Each  test  has  its  own 

pass/fail  criterion. 

ACVC:  Acronym  for  the  Ada  Compiler  Validation 

Capability. 


AVO; 


CHECK  or 
CHECKTEST: 


CUSTOMER : 


The  Ada  Validation  Office.  In  the  context 
of  this  report  the  AVO  is  responsible  for 
directing  compiler  validation. 


An  automated  tool  defined  by  the  Federal 
Software  Management  Support  Center  (FSMSC) 
and  developed  by  the  AVF  that  produces 
summary  test  results  by  reading  compiler 
output  in  a  spool  file. 

Honeywell  Information  Systems,  Inc. 


FSMSC; 

HOST: 

IG: 

RM: 

STANDARD : 

SUBSET  TESTS: 

TARGET : 

VALIDATION: 

VALIDATION  TESTS: 


Federal  Software  Management  Support  Center. 
In  the  context  of  this  report  the  FSMSC 
conducts  Ada  validations  under  contract  to 
the  AVO  as  a  satellite  facility. 

The  computer  on  which  the  compiler  executes . 

ACVC  Implementors’  Guide. 

The  Ada  Language  Reference  Manual. 

The  standard  for  the  Ada  language, 

ANSI/MIL-STD-1815A  (1983). 

A  grouping  of  ACVC  tests  selected  by  the 
FSMSC.  Each  chapter  in  the  ACVC  is 

represented  in  the  subset  by  between  4  to  7 
tests.  The  subset  is  used  for  statistical 
sampling  of  the  various  host  and  target 
hardware  configurations . 

The  computers  for  which  the  compiler 

generates  object  code. 

The  process  of  testing  a  compilation  system 
to  certify  that  it  conforms  to  the  standard. 

The  set  of  test  programs  used  to  detect 
non-conformances  in  compilation  systems.  In 
this  report,  the  term  will  be  used 
(unqualified)  to  mean  the  ACVC  tests. 
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2.  TEST  ANALYSIS 


The  following  table  shows  that  the  Honeywell  Information  Systems  (HIS) 
GCOS  6  Ada  compiler  passed  all  applicable  tests. 


A 

B 

C 

D 

E 

L 

Total 

In  suite 

61 

800 

1273 

17 

8 

3 

2162 

Inapplicable 

0 

1 

177 

2 

0 

0 

180 

Withdrawn 

0 

19 

47 

0 

0 

0 

66 

Passed 

61 

780 

1049 

15 

8 

3 

1916 

Failed 

0 

0 

0 

0 

0 

0 

0 

180  tests  in  the  suite  were  found  to  be  inapplicable  to  this 
implementation. 

In  addition,  66  tests  were  withdrawn  from  the  test  suite  because  they 
were  incorrect. 

2 . 1  Class  A  Testing 

Class  A  tests  check  that  legal  Ada  programs  can  be 
successfully  compiled.  These  tests  are  executed  but  contain 
no  executable  self -checking  capabilities. 

2.1.1  Class  A  Test  Procedures 

Each  class  A  test  was  separately  compiled  and  executed. 
However,  the  only  purpose  of  execution  is  to  produce  a  message 
indicating  that  the  test  passed. 

2.1.2  Class  A  Test  Results 

Successful  compilation  and  execution  without  any  error  messages 
indicates  the  tests  passed.  All  applicable  tests  passed. 

2 . 2  Class  B  Testing 

Class  B  tests  check  the  ability  to  recognize  illegal  language 
usage . 

2.2.1  Class  B  Test  Procedures 

Each  Class  B  test  was  separately  compiled.  The  resulting  test 
compilation  listings  are  manually  examined  to  see  whether 
every  illegal  construct  in  the  test  is  detected.  If  some 
errors  are  not  detected,  a  version  of  the  program  test  is 
created  that  contains  only  undetected  illegal  constructs. 
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This  revised  version  Is  recompiled  and  the  results  analyzed. 
If  some  errors  are  still  not  detected,  the  revision  process  Is 
repeated  until  a  revised  test  contains  only  a  single  previously 
undetected  Illegal  construct. 

A  B  test  Is  considered  to  fall  only  If  a  version  of  the  test 
containing  a  single  illegal  construct  Is  accepted  by  the 
compiler  (l.e.,  an  Illegal  construct  Is  not  detected)  or  a 
version  containing  no  errors  Is  rejected  (l.e.,  a  legal 
construct  Is  rejected). 

2.2.2  Class  B  Test  Results 

Class  B  tests  were  presented  to  the  compiler.  Of  these  tests  1 
was  found  to  be  Inapplicable  to  this  Implementation;  19  tests 
were  found  to  be  incorrect  (l.e.,  a  conforming  compiler  would 
have  failed  each  of  these  tests). 


Because  all  errors  were  not  detected  when  compiling  the 
original  tests,  the  following  44  tests  were  modified  by 
removing  the  detected  errors;  the  modified  tests  were  then 
submitted  again  to  see  If  the  remaining  errors  would  be 
detected. 


B22003A.ADA 

B35101A.ADA 

B53009A.ADA 

B61001W.ADA 

B91001A.ADA 

B91002D.ADA 

B91002H.ADA 

B91002L.ADA 

B97101E.ADA 

BCIOAEA.ADA 

BC1202A.ADA 


B29001A.ADA 

B37301A.ADA 

B54A01C.ADA 

B66001C.ADA 

B91002A.ADA 

B91002E.ADA 

B91002I.ADA 

B950ABA.ADA 

B97102A.ADA 

BCIOAEB.ADA 

BC1202B.ADA 


B33001A.ADA 

B37302A.ADA 

B55A01A.ADA 

B67001C.ADA 

B91002B.ADA 

B91002F.ADA 

B91002J.ADA 

B950ABB.ADA 

B97103E.ADA 

BCIOAED.ADA 

BC12ACA.ADA 


B33004A.ADA 

BSIOOU.ADA 

B61001R.ADA 

B67001D.ADA 

B91002C.ADA 

B91002G.ADA 

B91002K.ADA 

B9710U.ADA 

B97104G.ADA 

BCIOAFA.ADA 

BC20ABA.ADA 


All  Illegal  constructs  were  detected  except  in  some  tests  that 
were  withdrawn  because  of  errors  In  the  tests  (see  Section 
4.2.6) . 


2 . 3  Class  C  Testing 

Class  C  tests  check  that  legal  Ada  programs  are  correctly 
compiled  and  executed  by  an  Implementation. 

2.3.1  Class  C  Test  Procedures 


Each  Class  C  test  Is  separately  compiled  and  executed.  The 
tests  are  self -checking  and  produce  FASS/FAIL  messages .  Any 
'failed'  tests  are  Individually  checked  to  see  If  they  are 
correct  and  If  they  are  applicable  to  the  implementation.  Any 
tests  that  are  Inapplicable  or  that  do  not  conform  to  the  Ada 
Standard  are  withdrawn. 


-7- 


2.3.2 


2.4.1 


2.4.2 


2.5.1 


2.5.2 


All  class  C  tests  were  processed  except  the  tests  that  were 
withdrawn  and  tests  requiring  a  floating  point  precision 
exceeding  SYSTEM. MAX_DIGITS  and  those  tests  which  contained 
literals  greater  than  the  maxiDun  line  length  of  120 
characters.  All  applicable  tests  passed. 


Class  D  tests  are  executable  tests  used  to  check  an 
implementation's  compilation  and  execution  capacities.  Two 
tests  were  Inapplicable. 

Class  D  Test  Procedures 

Each  class  D  test  is  separately  compiled  and  executed.  The 
tests  are  self-checking  and  produce  PASS/FAIL  messages. 

Class  D  Test  Results 


All  applicable  class  D  tests  passed. 


Class  E  tests  provide  information  about  an  implementation's 
interpretation  of  the  Standard  where  the  Standard  permits 
implementations  to  differ.  Each  test  has  its  own  pass/fail 
criterion. 


Each  class  E  test  is  separately  compiled  and  executed.  The 
tests  are  self -checking  and  produce  pass/fall  messages. 


All  class  E  tests  passed. 


Class  L  tests  check  that  incomplete  or  Illegal  Ada  progr2uns 
involving  multiple  separately  compiled  source  files  are 
detected  at  link  time  and  are  not  allowed  to  execute. 


I  '4 


Each  Class  L  test  is  separately  compiled  and  execution  is 
attempted.  The  tests  produce  FAIL  messages  if  executed.  Any 
"failed"  tests  are  checked  to  see  if  they  are  correct  and 
applicable  to  the  Implementation.  Tests  that  are  inapplicable 
or  that  do  not  conform  to  the  Ada  standard  are  withdrawn. 


HU 


^'1 
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Class  L  Test  Results 


Of  the  class  L  tests,  none  vere  found  to  be  inapplicable  to 
this  implementation,  and  none  were  withdrawn  due  to  errors  in 
the  tests.  All  three  L  tests  passed. 


Subset  Testing 

A  subset  of  the  executable  ACVC  tests  was  chosen  by  the  FSMSC 
and  used  during  this  validation.  This  subset  of  tests  was  used 
to  test  multiple  configuration  combinations  during  the 
validation,  specifically  Honeywell  DPS  6/95,  6/94,  6/85,  6/75, 
6/74  and  6/70  host/target  relationships. 


The  subset  comprised  the  following  tests: 


Chapter  2 

Chapter  3 

C23001A 

C3400U 

C24102A 

C34001H 

C26008A 

A32203D 

A29002A 

C35904A 

C36204A 

C34002B 

Chapter  6 

Chapter  7 

C61003B 

A71002A 

A62006D 

C72001B 

C63004A 

C74302A 

C65003A 

C74209A 

C66002A 

C74409B 

Chapter  10 

Chapter  11 

CA1003A 

CBIOOIA 

CA2004A 

CB2004A 

CA2004A1 

CB3003A 

CA2004A2 

CB4001A 

CA2004A3 

CA2004A4 

Chapter  4 

Chapter  5 

C41101D 

C51002A 

C42005A 

C52001A 

C43214A 

C53005A 

C45101A 

C54A03A 

C48004A 

D55A03A 

Chapter  8 

Chapter  9 

A83A02A 

C92002A 

C84002A 

C93001A 

C85007E 

C94006A 

C86003A 

A97106A 

C87B48A 

C97202A 

Chapter  12 

Chapter  14 

CC1004A 

AE210U 

CC3004A 

CE2102A 

CC3408A 

CE220U 

CC3504C 

CE2401E 

CE3102A 

CE3901A 

***  CZ  *** 


CZllOU 

CZ1102A 

CZ1103A 

CZ1201A 

CZ1201B 

CZ1201C 

CZ1201D 


3.  COMPILER  ANOMALIES  AND  NONCONFORMANCE 


There  were  no  nonconformances  to  the  Ada  standard  detected  In  this 
validation.  The  compiler  passed  all  applicable  correct  tests. 
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4.  ADDITIONAL  INFORMATION 


This  section  describes  in  more  detail  how  the  validation  was  concluded. 

4.1  Compiler  Parameters 

Certain  tests  do  not  apply  to  all  Ada  compilers,  e.g., 
compilers  are  not  required  to  support  several  predefined 
floating  point  types,  and  so  tests  must  be  selected  based  on 
the  predefined  types  an  implementation  actually  supports.  In 
addition,  some  tests  are  parameterized  according  to  the  maximum 
length  allowed  by  an  implementation  for  an  identifier  (or  other 
lexical  element;  this  is  also  the  maximum  line  length),  the 
maximum  floating  point  precision  supported,  etc.  The 
implementation  dependent  parameters  used  in  performing  this 
validation  were: 

maximum  lexical  element  length:  120  characters. 

maximum  digits  value  for  floating  point  types  15 
(fifteen) 

SYSTEM. M1N_INT:  -2  **  31 
SYSTEM. MAX_1NT:  2  **  31-1 

predefined  numeric  types:  INTEGER,  FLOAT,  L0NG_INTEGER, 
L0NG_FL0AT  and  SHORT_INTEGER . 

INTEGER_FIRST:  -32768 

INTEGER.LAST:  32768 

.  LONG.INTEGER’ FIRST:  -2_147_483_648 

LONG_INTEGER'LAST:  2_147_483_647 

Source  character  set:  ASCII 

Extended  ASCII  chars:  abcdefghijklmnopqrstuvwxyz 

non-ascii  char  type:  GCOS  6  Ada  accepts  only  ASCII 
characters 

TEXT_I0 . COUNT' LAST :  16#7FFFFFFF# 

.  TEXT_I0. FIELD' LAST:  35 

illegal  external  file  namel:  BAD  CHAR[S] 

illegal  external  file  name2:  ''T00_L0NG_A_FILE_NAME'' 

.  SYSTEM. PRIORITY' FIRST:  0 
.  SYSTEM. PRIORITY' LAST:  48 


Complete  ACVC  tests  runs  were  compiled/executed  at  Honeywell, 
Information  Systems,  Inc.,  Billerica,  MA.  and  Lawrence,  MA.  No 
attempt  was  made  to  establish  cross  compatibility  among  all 
configurations,  but  the  DPS  6  product  line  compatibility 
indicates  that  processors  validated  as  a  host  can  treat  any 
equal  or  lower  member  of  the  line  as  a  target. 

4.2.1  Pre-Test  Procedures 

Prior  to  testing,  appropriate  values  for  the  compiler-dependent 
parameters  were  determined.  These  values  were  used  to  adapt 
tests  that  depend  on  the  values.  A  magnetic  tape  containing  the 
adapted  tests  was  prepared  and  brought  to  the  testing  site. 
Spilt  B  tests  were  not  prepared  on  this  tape  and  had  to  be 
split  on-slte. 

The  HIS  pre -validation  consisted  of  two  complete  runs  of  the 
ACVC  on  the  HIS  DPS  6/94  running  under  GCOS  6  HOD  400  release 
3.0  and  3.1  operating  systems,  and  extensive  subset  testing  of 


the  HIS  DPS 
table : 

6/75,  6/74 

,  and 

6/70  as  shown 

In  the  following 

Host 

Op  Svs 

Tareet 

Op  Svs 

ACVC  Portion 

Test  Location 

DPS  6/94 

3.0 

DPS  6/94 

3.0 

Full 

Pre-Val 

DPS  6/94 

3.1 

DPS  6/94 

3.1 

Full 

Pre-Val 

DPS  6/75 

3.0 

DPS  6/75 

3.0 

Subset 

Pre-Val 

DPS  6/75 

3.1 

DPS  6/75 

3.1 

Subset 

Pre-Val 

DPS  6/74 

3.0 

DPS  6/74 

3.0 

Subset 

Pre-Val 

DPS  6/74 

3.1 

DPS  6/74 

3.1 

Subset 

Pre-Val 

DPS  6/70 

3.0 

DPS  6/70 

3.0 

Subset 

Pre-Val 

DPS  6/70 

3.1 

DPS  6/70 

3.1 

Subset 

Pre-Val 

4.2.2  Control  Files 

HIS  provided  command  procedures  that  compiled  and  executed 
tests  automatically  at  the  HIS  site.  All  command  procedures 
were  reviewed  prior  to  the  on-site  validation. 
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Two  complete  ACVC  runs  were  made  on  the  DPS  6/95  under  both  3.0 
and  3.1  operating  systems.  The  results  from  the  DPS  6/95  were 
analyzed;  they  were  determined  to  be  correct. 

The  ACVC  subset  groups  were  compiled  and  executed  on  DPS  6/85, 
operating  system  3.1,  and  then  that  object  code  was  run  on  the 
DPS  6/75;  the  results  were  compared  and  no  significant 
differences  were  detected.  Also  object  code  from  a  subset  of 
the  tests  on  the  DPS  6/95,  operating  systems  3.0  and  3.1,  was 
successfully  executed  on  the  DPS  6/75,  operating  systems  3.0 
and  3.1.  No  deviations  were  noted. 

The  following  table  shows  the  on-site  tests: 


DPS 

6/95 

3.0 

DPS  6/95 
DPS  6/75 

3 

3 

DP? 

6/95 

3.1 

DPS  6/95 
DPS  6/75 

3 

3 

DPS 

6/85 

3.1 

DPS  6/85 
DPS  6/75 

3 

3 

Full 

On-Site 

Subset 

On-Site 

Full 

On-Site 

Subset 

On-Site 

Subset 

On-Site 

Subset 

On-Site 

On  completion  of  testing  the  base  system,  all  results  were 
analyzed  for  failed  Class  A,  C,  D,  E,  or  L  programs,  and  all 
class  B  compilation  results  were  individually  analyzed. 
Analysis  procedures  are  described  for  each  test  class  in 
chapter  2. 

Timing  Information 

The  real  (wall  clock)  times  required  for  ..compiling  the 
non-executable  tests  and  compiling,  linking,  afid  running  the 
executable  tests  were: 

DPS  6/95  (MOD  400,  3.1)  76  hrs  53  mins.  (Includes  Class  B) 
DPS  6/95  (HOD  400,  3.0)  73  hrs  39  mins.  (Includes  Class  B) 


Description  of  Errors  in  Withdrawn  Tests 

The  following  tests  in  version  1.6  of  the  ACVC  did  not  conform 
to  the  ANSI  Ada  standard  and  were  withdrawn  for  the  reasons 
given  below: 

B66001A-B:  Test  checks  (in  section  G)  that  a 
parameterless  function  that  is  equivalent  to  an 
enumeration  literal  in  the  same  declarative  region  is  a 
redeclaration  and,  as  such,  is  forbidden.  According  to 
RM  8.3(17),  the  explicit  declaration  of  such  a  function 
is  allowed  if  an  enumeration  literal  is  considered  to  be 
an  implicitly  declared  predefined  operation.  The  RM  is 
not  clear  on  this  point.  This  issue  has  been  referred 
to  the  Language  Maintenance  Committee  for  resolution. 
Since  the  issue  cannot  be  resolved  at  this  time,  the 
test  is  withdrawn  from  Version  1.6.  (Please  note  that 
this  test  may  be  considered  correct  and  may  appear  in 
the  future  Versions  of  the  ACVC,  including  Version  1.6.) 

BC1013A-B:  The  declaration  of  equality  in  lines  86-87 
is  illegal  because  the  parameter  type  T  declared  in  line 
11  is  not  a  limited  type  (LRM  6.7-4). 

B38105B:  This  test  requires  a  specific  interpretation 
of  the  Language  Reference  Manual  (LRM)  regarding  whether 
an  incomplete  type  can  have  discriminant  constraints 
before  the  full  type  declaration;  this  interpretation 
is  not  fully  supported  by  the  LRM  or  Language 
Maintenance  Committee. 


C45S21A,  C45S21B.  ...  C45521Y  (25  tests)  :  Cases  C  and  I 
define  the  model  Interval  for  the  result  too  narrowly. 

C48005C-B:  Lines  38  and  63  of  this  test  should  check 
that  the  value  of  the  designated  object  is  null. 

C48006B:  This  test  requires  a  specific  interpretation 
of  the  Language  Reference  Manual  (LRH)  regarding  whether 
an  incomplete  type  can  have  discriminant  constraints 
before  the  full  type  declaration;  this  interpretation 
is  not  fully  supported  by  the  LRM  or  Language 
Maintenance  Committee. 

C64,103C-B:  This  test  should  raise  CONSTRAINT_ERROR 
during  the  conversion  at  line  179. 

C6A103D-B:  This  test  involves  a  CONSTRAIMT_ERROR  vs. 

NUMERIC _ ERROR  issue  that  Is  to  be  resolved  by  the 

Language  Maintenance  Committee. 

C64105E-AB:  For  case  E.  ensure  that  non-null  dimensions 
of  formal  and  actual  parameters  belong  to  both  index 
subtypes  (see  AI-00313). 

C64105F-AB:  For  case  E.  ensure  that  non-null  dimensions 
of  formal  and  actual  parameters  belong  to  both  index 
subtypes  (See  AI-00313). 

B6700U-B:  Line  414  is  missing  the  -BEGIN  NULL;  END;" 
needed  to  complete  the  block  beginning  at  line  389  (case 
H). 

B67004A-B:  The  default  name  for  a  formal  generic 
equality  function  should  not  be  allowed  to  be  ”/■•" 
unless  an  expanded  name  is  used. 

B74103F-B;  This  test  hinges  on  whether  or  not  a  generic 
formal  type  declaration  declares  a  type.  This  matter 
will  be  debated  and  resolved  by  the  Committee. 

B74207A-B:  This  test  requires  a  specific  interpretation 
of  the  Language  Reference  Manual  (LRM)  regarding  whether 
an  incomplete  type  can  have  discriminant  constraints 
before  the  full  type  declaration;  this  interpretation  is 
not  fully  supported  by  the  LRM  or  Language  Maintenance 
Committee. 

C93005A,  C9300SB,  and  C9300SC:  These  tests  contain  a 
declaration  of  an  interger  variable  whose  initialization 
la  solely  for  the  purpose  of  raising  an  exception.  Some 
compilers  will  not  raise  this  exception  due  to  their 
optimization. 


C93007B-B:  This  test  should  check  for  PROGRAM_ERROR 

rather  than  TASKING_ERROR  (See  AI-000149). 

CA1003B-AB:  A  compilation  that  contains  an  illegal 

compilation  unit  may  now  be  rejected  as  a  whole  (see 
Al-00255/05). 

CA1011A*-B:  The  test  objective  should  be  reversed  to  be 

consistent  with  AI -00199. 

CA1108A-B:  A  pragma  ELABORATE  is  needed  for  0THER_PKG 

at  line  25. 

CA1108B-B:  A  pragma  ELABORATE  is  needed  for  FIRST.PKG 

at  line  39  and  for  LATER.PKG  at  line  49. 

CA2009B-B,  CA2009E-B:  The  repetition  of  the  main 

procedure  after  the  subunit  body  makes  the  subunit  body 
obsolete;  therefore,  an  attempt  to  execute  the  main 
procedure  will  fail. 

CA2009F*-B:  The  file  CA2009F2-B  is  missing  from  the 

test  suite. 

BC3204A-B,  BC3204B-B.  BC3204C*-B,  BC3204D-B,  BC3205A-B, 

BC3205B-B,  BC3205C-B,  BC3205D*-B,  BC3405B-B: 

Instantiations  with  types  that  have  default 
discriminants  are  now  legal  (AI-00037). 

BC3S03A-B.  This  test  requires  a  specific  interpretation 
of  the  Language  Reference  Manual  (LRM>  regarding  whether 
an  incomplete  type  can  have  discriminant  contraints 
before  the  full  type  declaration;  this  Interpretation  is 
not  fully  supported  by  the  LRH  or  Language  Maintenance 
Committee . 

CE2107E-B.  This  test  has  a  variable,  TEMP_HAS_TRUE , 
that  needs  to  be  given  an  initial  value  of  TRUE. 

CE3603A-B:  The  last  case  is  inconsistent  with  AI-00050. 

If  the  string  argument  is  null,  no  attempt  to  read  is 
made  and  END_ERR0R  is  not  raised. 

CE3604A-B:  Cases  5,  8,  9,  and  11  are  inconsistent  with 

AI-00050.  SKIP_LINE  is  called  only  if  the  end  of  the 
output  string  has  not  been  met. 

CE3704M-B:  A  superfluous  SKIP_LINE  causes  the  input  and 

output  operations  to  be  out  of  synchronization. 


C35904A-B:  The  elaborations  of  the  subtype  declarations 

for  SFX3  and  SFXA  In  this  test  raise  NUMERIC_ERROR  In 
some  Implementations.  The  exception  Is  raised  on  the 
conversion  of  the  real  literals  2.0  and  5.0  to  the  base 
type  of  FIX. 

BA2001E**Afi:  LRH  10.2(5)  states  that  "simple  names  of 

all  subunits  that  have  the  same  ancestor  library  unit 
must  be  distinct  Identifiers."  This  test  requires  that 
the  above  conditions  be  checked  when  the  stub  Is 
declared;  but  since  the  LRM  uses  the  term  "subunit",  it 
Is  not  clear  that  the  check  must  be  made  then,  as 
opposed  to  when  the  subunit  Is  compiled.  (There  may  be 
an  LMC  ruling  regarding  this  Issue.) 

BC3220B-B:  This  test  assumes  that  instantiated  types 

may  be  static.  This  assumption  has  been  questioned,  and 
the  matter  will  be  considered  by  the  LMC. 

Description  of  Inapplicable  Tests 

D4A002B  64-blt  Integers  are  not  supported. 

D4A004B  64-bit  Integers  are  not  supported. 

B86001CP  SH0RT_FL0AT  not  supported. 

C24113H,  C24113I,  C24113J,  C24113K  These  programs  were 

rejected  because  they  contain  literals  which  exceed  the  maximum 
line  length  of  120  characters. 

C96005B  The  test  Itself  states  not-appllcable  because 
DURATION'S  BASE  -  DURATION.. 

CA2009COM  GCOS  6  Ada  requires  that  subunits  of  a  generic  unit 
be  part  of  the  same  compilation. 

CE2107C  Test  was  Inapplicable  because  a  file  open  for  output 
cannot  be  associated  with  more  than  one  Internal  file. 

CE2107D  Test  was  Inapplicable  because  a  file  open  for  output 
cannot  be  associated  with  more  than  one  internal  file. 

CE2108A  Vas  Inapplicable  because  temporary  files  do  not  have 
names  on  this  system.  Therefore,  calls  to  NAME  for  temporary 
files  raise  USE  ERROR. 


CE2108C  Vas  Inapplicable  because  temporary  files  do  not  have 
names  on  this  system.  Therefore,  calls  to  NAME  for  temporary 
files  raise  USE.ERROR. 


CE2110B  Test  was  inapplicable  because  implementation  does  not 
allow  you  to  CREATE  a  file. 

CE2111D  Test  was  inapplicable  because  implementation  does  not 
allow  you  to  CREATE  a  file. 

CE3111B  Test  was  inapplicable  because  multiple  internal  files 
may  not  access  the  same  external  or  temporary  file. 

CE3111C  Test  was  inapplicable  because  multiple  internal  files 
may  not  access  the  same  external  or  temporary  file. 

CE3111D  Test  was  inapplicable  because  multiple  internal  files 
may  not  access  the  same  external  or  temporary  file. 

CE3111E  Test  was  inapplicable  because  multiple  internal  files 
may  not  access  the  same  external  or  temporary  file. 

CE3112A  Vas  Inapplicable  because  temporary  files  do  not  have 
names  on  this  system.  Therefore,  calls  to  NAME  for  temporary 
files  raise  USE_ERROR. 

CE3114B  Test  Incorrectly  reports  failure  when  STATUS_ERROR 
results  from  attempts  to  DELETE  unopened  files. 

CE3115A  Test  Incorrectly  reports  failure  when  USE_ERROR  results 
from  attempts  to  CREATE  files. 

The  following  tests  were  Inapplicable  because  they  exceed  the 

machine  capacity  using  DIGITS _ ^precision  greater  than  MAX 

DIGITS  -  15; 

C24113L  through  C24113Y  (14) 

C35705L  through  C35705Y  (14) 

C35706L  through  C35706Y  (14) 

C35707L  through  C35707Y  (14) 

C35708L  through  C35707Y  (14) 

C35802L  through  C35802Y  (14) 

C45241L  through  C45241Y  (14) 

C45321L  through  C45321Y  (14) 

C45421L  through  C45421Y  (14) 

C45424L  through  C45424Y  (14) 

C45621L  through  C45621Z  (15).  (-155  tests,  total) 

C34001F  SHORT_FLOAT  not  supported. 

C35702A  SHORT_FLOAT  not  supported. 

C64103A:  This  test  is  invalid  in  that  1jG_FL0AT’  LARGE  may  be  in 
the  range  of  SM.FLOAT  safe  numbers  and  therefore  numeric  error 
should  not  be  raised.  See  LRH  4.5.7  para  7  &  8. 
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Processing  of  the  following  tests  Indicated  support  as 
described  below  for  a  variety  of  Implementation  options 
examined  by  the  tests . 


E2A101A-B.TST:  If  a  based  integer  literal  has  a  value 
exceeding  SYSTEM .MAX  INT.  an  Implementation  may  either 
reject  the  compilation  unit  at  compile  time  or  raise 

NUMERIC _ ERROR  at  run  time.  This  test  showed  that  the 

compiler  did  not  reject  the  compilation  unit  at  compile 
time  and  NUMERIC_ERROR  was  raised. 

B26005A.ADA:  This  test  contains  all  the  ASCII  control 
characters  in  string  literals.  The  system  replaced  the 
control  characters  corresponding  to  format  effectors 
with  a  space  in  the  listing  file.  All  occurrences  were 
identified  with  a  diagnostic  message  by  the  compiler. 

D29002K-B . ADA:  This  test  declares  713  identifiers  and 
was  passed  by  the  compiler. 

E36202A-B.ADA  and  E36202B-B.ADA:  These  tests  declare 
multidimensional  null  BOOLEAN  arrays  in  which  LENGTH  of 
one  dimension  exceeds  INTEGER’ LAST  and  SYSTEM . MAX.INT , 
respectively.  An  implementation  can  accept  this,  or  it 

can  raise  NUMERIC _ ERROR  or  STORAGE_ERROR  at  run  time. 

The  compiler  did  accept  the  declarations  and  raised 
NUMERIC_ERROR  during  execution. 

D4A002A-AB.ADA  and  D4A0026.ADA:  These  tests  contain 
universal  integer  calculations  requiring  32  and  64  bits 
of  accuracy,  i.e.,  values  that  exceed  SYSTEM . MAX^INT  are 
used.  An  implementation  is  allowed  to  reject  programs 
requiring  such  calculations.  The  compiler  passed  these 
tests . 

E43211B-B.ADA:  If  a  bound  in  a  non-null  range  of  a 
non-null  aggregate  does  not  belong  to  an  index  subtype, 
then  all  choices  may  or  may  not  be  evaluated  before 
CONSTRAINT  ERROR  is  raised.  The  compiler  did  not 
evaluate  all  choices  before  CONSTRAINT_ERROR  is  raised. 

E43212B-B. ADA:  This  test  examines  whether  or  not  all 
choices  are  evaluated  before  subaggregates  are  checked 
for  identical  bounds.  The  compiler  evaluates  all 
subaggregates  for  identical  bounds. 


-19- 


E52103Y-B.ADA.  C52104X-B.ADA,  C52104Y-B.ADA:  These 
tests  declare  BOOLEAN  arrays  with  INTEGER' LAST-t-3 
components.  An  implementation  may  raise  NUHERIC_ERROR 

at  the  type  declaration  or  STORAGE _ ERROR  when  array 

objects  of  these  types  are  declared,  or  it  may  accept 
the  type  and  object  declarations.  The  compiler  did  not 
raise  NUMERIC.ERROR  for  null  array  with  one  dimension  of 
length  greater”than  INTEGER' LAST  in  E52103Y-B. 

A  series  of  tests  (D5SA03*>AB. ADA)  checks  to  see  what 
level  of  loop  nesting  is  allowed  by  an  implementation. 
Tests  containing  up  to  65  nested  loops  passed  without 
exceeding  the  implementation's  capacity. 

D56001B-AB.ADA  contains  blocks  nested  65  levels  deep. 
This  test  was  passed. 

C94004A-B.ADA:  This  test  checks  to  see  what  happens 
when  a  library  unit  initiates  a  task  and  a  main  program 
terminates  without  ensuring  that  the  library  vmit's  task 
is  terminated.  This  test  showed  that  such  library  tasks 
continued  to  execute  even  after  the  main  program 
terminates  and  then  terminated  appropriately  by 
themselves . 

CA1012AAM-B.DEP:  This  test  checks  whether  an 
implementation  requires  generic  library  unit  bodies  to 
be  compiled  in  the  same  compilation  as  the  generic 
declaration.  The  compiler  does  allow  generic 
declarations  and  bodies  to  be  compiled  in  completely 
separate  compilations. 

CE2106A-B.DEP  and  CE3110A-B.DEP:  These  tests  confirm 
that  dynamic  creation  and  deletion  of  files  is  not 
supported. 

CE2107A.DEP;  This  test  showed  that  more  than  one 
Internal  file  may  be  associated  with  the  same  external 
file  (for  sequential  and  direct  I/O). 

CE3111A-B.DEP  showed  that  two  internal  files  may  read 
the  same  external  file. 
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5.  SUMMARY  AND  CONCLUSIONS 


ACVC  vtrsion  1.6  comprises  2162  tests,  of  which  66  were  wlthdrsvn  due  to 
errors.  The  Federal  Software  Management  Support  Center  (FSMSC) ,  an  AVF, 
Identified  1916  of  the  remaining  teats  to  be  applicable  to  Honeywell 
Information  Systems  Inc.'s  CC0S6  Ada  compiler.  The  compiler  passed  all 
of  these  tests,  operating  on  DPS  6/95,  DPS  6/94,  DPS  6/85,  DPS  6/75,  DPS 
6/74,  DPS  6/70  under  MOD  400  Operating  System  Release  3.0  and  3.1. 

The  FSMSC  considers  these  results  to  show  acceptable  conformity  to  the 
Ada  Language  Standard. 


